SPECIFICATION 

TO ALL WHOM IT MAY CONCERN: 

Be it known that we, Vij Rajarajan, a citizen of India, 
residing at 4963 166th Court NE, Redmond, Washington 98052, 
Casey L. Kiernan, a citizen of the United States residing at 
1907 2nd Street, Kirkland, Washington 98033, Stewart P. 
MacLeod, a citizen of the United States, residing at 22115 NE 
140th Way, Woodinville, Washington 98072 and Shawn E. Oberst, 
a citizen of the United States, residing at 27602 221st SE, 
Maple Valley, Washington 98038 have invented a certain new and 
useful PLUGGABLE NOTATIONS AND SEMANTICS FOR VISUAL MODELING 
ELEMENTS of which the following is a specification. 




PLUGGABLE NOTATIONS AND SEMANTICS FOR VISUAL MODELING 

ELEMENTS 

5 FIELD OF THE INVENTION 

The present invention is generally directed to computer 
systems, and more particularly to visualization and modeling 
in computer systems . 

10 BACKGROUND OF THE INVENTION 

Visualization and modeling software is extensively used 
in industry. Visualization generally refers to computer tools 
for viewing existing layouts, such as for viewing a 
representation of a network topology, an electrical wiring 

15 system or various other things that are designed. 

Visualization has general relevance in various applications, 
e.g., viewing a network topology is a scenario that is 
applicable to many different products. Modeling refers to 
computer tools used to design things, such as software, 

20 databases, integrated circuits, CAD/CAM applications and the 
like. Thus, in general, in visualization, a user looks at 
interconnected model elements placed on a viewing surface. In 
modeling, a user places the model elements on a work surface 
and connects them together in some manner. The semantics of 

25 connecting two or more model elements using other model 
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elements is the fundamental operation in modeling and 
visualization. 

However, existing visualization and modeling tools have a 
number of drawbacks, including that the developers of the 
5 tools have made them closed and proprietary. For example, the 
file formats that store the designs are proprietary. 
Similarly, the rules and semantics of connecting two or more 
model elements together are embedded in the modeling tool. 
For example, an integrated circuit design tool will allow or 

10 disallow a connection between two elements such as a node and 
a connecting arc based on some hard-coded knowledge about 
those elements. As a consequence, the tool that has the hard- 
coded rules and semantics, and the model elements, typically 
come from the same vendor, or at least come from sources 

15 having detailed knowledge of one another, resulting in a 
closed and proprietary tool in which independent software 
vendors (ISVs) or other third parties cannot participate. For 
example, the model elements of one vendor cannot be used with 
the modeling software of another vendor. Thus, if someone 

20 were to create a model diagram using one standard, (e.g., 
IDEF) , they cannot plug-in another standard's (e.g., UML) 
model elements and view them as a UML diagram. 
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SUMMARY OF THE INVENTION 

Briefly, the present invention provides a method and 
system that logically separate the notation (e.g., visual 
representation such as an icon, image or shape, e.g., circle, 
5 a triangle or a line) of a model element object, from the 
semantics of that notation, (e.g., what the notation 
represents or means in its current environment) . The present 
invention, implemented in a Visual Modeling Framework (VMF) , 
separates these two logical concepts into separate code 

10 components, whereby various notations and semantics from 

different providers may be combined. VMF defines the API set 
/ interfaces to which pluggable semantic and notation objects 
conform, and allows a notation and a semantic to be plugged 
into or otherwise associated with each other to create a model 

15 element, thereby allowing pluggable notations. VMF also 

allows pluggable semantics, e.g., to enable UML notations to 
be used to design a complex software diagram, yet switch 
between ^Semantic' objects for Visual Basic and ^Semantic' 
objects in C++. 

20 In one implementation, a paradigm server loads the 

semantic component and the notation component of the user^s 
choice, combines them, and presents the combination to the VMF 
as a model element. In general, paradigm servers define a 




particular discipline of modeling, e.g., software design or 
database design. The paradigm server components are also 
preferably pluggable components, having specialized knowledge 
that allows them to validate if a semantic object can be used 
5 in a paradigm and combined with a given notation. For 

example, a software design semantic object may not be plugged 
with any notation object if the paradigm being used in the 
tool is for database design. Allowing for such pluggable 
notations and semantics, which are in turn encapsulated in 
10 pluggable paradigms, provides a rich architecture that allows 
for broader functionality and customization than currently 
available . 

Other advantages will become apparent from the following 
detailed description when taken in conjunction with the 
15 drawings, in which: 



BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 is a block diagram representing a computer 
system into which the present invention may be incorporated; 
20 FIG. 2 is a block diagram generally representing a 

visualization and modeling framework (VMF) in which separate 
notations and semantics may be associated into a model element 
in accordance with an aspect of the present invention; 

- 4 - 




FIG. 3 is a block diagram generally representing 
exemplary components in the VMF by which separate notations 
and semantics may be associated into a model element in 
accordance with an aspect of the present invention; 
5 FIG. 4 is a block diagram generally representing a 

physical architecture of the VMF in accordance with an aspect 
of the present invention; 

FIG. 5 is a representation of a modeling surface window 
having model elements thereon comprised of notations and 
10 semantics in accordance with an aspect of the present 
invention; 

FIGS. 6-9 comprise a block diagram generally describing 
the VMF objects and certain functions, including interfaces 
and methods related to having separate semantics and notations 
15 in accordance with an aspect of the present invention; and 

FIG. 10 comprises a logical flow diagram for associating 
a selected semantic with a selected notation to produce a 
model element in accordance with an aspect of the present 
invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

EXEMPLARY OPERATING ENVIRONMENT 

FIGURE 1 illustrates an example of a suitable computing 
5 system environment 100 on which the invention may be 

implemented. The computing system environment 100 is only one 
example of a suitable computing environment and is not 
intended to suggest any limitation as to the scope of use or 
functionality of the invention. Neither should the computing 

10 environment 100 be interpreted as having any dependency or 

requirement relating to any one or combination of components 
illustrated in the exemplary operating environment 100. 

The invention is operational with numerous other general 
purpose or special purpose computing system environments or 

15 configurations. Examples of well known computing systems, 

environments, and/or configurations that may be suitable for 
use with the invention include, but are not limited to, 
personal computers, server computers, hand-held or laptop 
devices, multiprocessor systems, microprocessor-based systems, 

20 set top boxes, programmable consumer electronics, network PCs, 
minicomputers, mainframe computers, distributed computing 
environments that include any of the above systems or devices, 
and the like. 



The invention may be described in the general context of 
computer-executable instructions, such as program modules, 
being executed by a computer. Generally, program modules 
include routines, programs, objects, components, data 
structures, and so forth, that perform particular tasks or 
implement particular abstract data types. The invention may 
also be practiced in distributed computing environments where 
tasks are performed by remote processing devices that are 
linked through a communications network. In a distributed 
computing environment, program modules may be located in both 
local and remote computer storage media including memory 
storage devices. 

With reference to Figure 1, an exemplary system for 
implementing the invention includes a general purpose 
computing device in the form of a computer 110. Components of 
the computer 110 may include, but are not limited to, a 
processing unit 120, a system memory 130, and a system bus 121 
that couples various system components including the system 
memory to the processing unit 120. The system bus 121 may be 
any of several types of bus structures including a memory bus 
or memory controller, a peripheral bus, and a local bus using 
any of a variety of bus architectures. By way of example, and 
not limitation, such architectures include Industry Standard 




Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, 
Enhanced ISA (EISA) bus, Video Electronics Standards 
Association (VESA) local bus, and Peripheral Component 
Interconnect (PCI) bus also known as Mezzanine bus. 
5 Computer 110 typically includes a variety of computer- 

readable media. Computer-readable media can be any available 
media that can be accessed by the computer 110 and includes 
both volatile and nonvolatile media, and removable and non- 
removable media. By way of example, and not limitation, 

10 computer-readable media may comprise computer storage media 

and communication media. Computer storage media includes both 
volatile and nonvolatile, removable and non-removable media 
implemented in any method or technology for storage of 
information such as computer-readable instructions, data 

15 structures, program modules or other data. Computer storage 
media includes, but is not limited to, RAM, ROM, EEPROM, flash 
memory or other memory technology, CD-ROM, digital versatile 
disks (DVD) or other optical disk storage, magnetic cassettes, 
magnetic tape, magnetic disk storage or other magnetic storage 

20 devices, or any other medium which can be used to store the 
desired information and which can accessed by the computer 
110. Communication media typically embodies computer-readable 
instructions, data structures, program modules or other data 




in a modulated data signal such as a carrier wave or other 
transport mechanism and includes any information delivery 
media. The term "modulated data signal" means a signal that 
has one or more of its characteristics set or changed in such 
5 a manner as to encode information in the signal . By way of 
example, and not limitation, communication media includes 
wired media such as a wired network or direct-wired 
connection, and wireless media such as acoustic, RF, infrared 
and other wireless media. Combinations of the any of the 

10 above should also be included within the scope of computer- 
readable media. 

The system memory 130 includes computer storage media in 
the form of volatile and/or nonvolatile memory such as read 
only memory (ROM) 131 and random access memory (RAM) 132. A 

15 basic input/output system 133 (BIOS) , containing the basic 
routines that help to transfer information between elements 
within computer 110, such as during start-up, is typically 
stored in ROM 131. RAM 132 typically contains data and/or 
program modules that are immediately accessible to and/or 

20 presently being operated on by processing unit 120. By way of 
example, and not limitation. Figure 1 illustrates operating 
system 134, application programs 135, other program modules 
136 and program data 137. 




The computer 110 may also include other removable/non- 
removable, volatile/nonvolatile computer storage media. By 
way of example only, Figure 1 illustrates a hard disk drive 
140 that reads from or writes to non-removable, nonvolatile 
5 magnetic media, a magnetic disk drive 151 that reads from or 
writes to a removable, nonvolatile magnetic disk 152, and an 
optical disk drive 155 that reads from or writes to a 
removable, nonvolatile optical disk 156 such as a CD ROM or 
other optical media. Other removable/non-removable, 

10 volatile/nonvolatile computer storage media that can be used 
in the exemplary operating environment include, but are not 
limited to, magnetic tape cassettes, flash memory cards, 
digital versatile disks, digital video tape, solid state RAM, 
solid state ROM, and the like. The hard disk drive 141 is 

15 typically connected to the system bus 121 through a non- 
removable memory interface such as interface 140, and magnetic 
disk drive 151 and optical disk drive 155 are typically 
connected to the system bus 121 by a removable memory 
interface, such as interface 150. 

20 The drives and their associated computer storage media, 

discussed above and illustrated in Figure 1, provide storage 
of computer-readable instructions, data structures, program 
modules and other data for the computer 110. In Figure 1, for 
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example, hard disk drive 141 is illustrated as storing 
operating system 144, application prograims 145, other program 
modules 146 and program data 147. Note that these components 
can either be the same as or different from operating system 
5 134, application programs 135, other program modules 136, and 
program data 137. Operating system 144, application programs 
145, other program modules 146, and program data 147 are given 
different numbers herein to illustrate that, at a minimum, 
they are different copies. A user may enter commands and 

10 information into the computer 20 through input devices such as 
a keyboard 162 and pointing device 161, commonly referred to 
as a mouse, trackball or touch pad. Other input devices (not 
shown) may include a microphone, joystick, game pad, satellite 
dish, scanner, or the like. These and other input devices are 

15 often connected to the processing unit 120 through a user 

input interface 160 that is coupled to the system bus, but may 
be connected by other interface and bus structures, such as a 
parallel port, game port or a universal serial bus (USB) , A 
monitor 191 or other type of display device is also connected 

20 to the system bus 121 via an interface, such as a video 

interface 190. In addition to the monitor, computers may also 
include other peripheral output devices such as speakers 197 
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and printer 196, which may be connected through a output 
peripheral interface 190. 

The computer 110 may operate in a networked environment 
using logical connections to one or more remote computers, 
5 such as a remote computer 180. The remote computer 180 may be 
a personal computer, a server, a router, a network PC, a peer 
device or other common network node, and typically includes 
many or all of the elements described above relative to the 
computer 110, although only a memory storage device 181 has 

10 been illustrated in Figure 1. The logical connections 

depicted in Figure 1 include a local area network (LAN) 171 
and a wide area network (WAN) 173, but may also include other 
networks. Such networking environments are commonplace in 
offices, enterprise-wide computer networks, intranets and the 

15 Internet. 

When used in a LAN networking environment, the computer 
110 is connected to the LAN 171 through a network interface or 
adapter 170. When used in a WAN networking environment, the 
computer 110 typically includes a modem 172 or other means for 
20 establishing communications over the WAN 173, such as the 

Internet. The modem 172, which may be internal or external, 
may be connected to the system bus 121 via the user input 
interface 160 or other appropriate mechanism. In a networked 
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environment, program modules depicted relative to the computer 
110, or portions thereof, may be stored in the remote memory 
storage device. By way of example, and not limitation. Figure 
1 illustrates remote application programs 185 as residing on 
5 memory device 181. It will be appreciated that the network 
connections shown are exemplary and other means of 
establishing a communications link between the computers may 
be used. 

10 VISUAL MODELING FRAMEWORK 

As generally represented in FIGS. 2-4, the Visualization 
and Modeling Framework (VMF) is a component-based framework 
200 for visualization and modeling tools. VMF is a general- 
purpose modeling tool having a paradigm- independent surface 

15 202 capable of modeling numerous kinds of model elements. 
Nevertheless, unlike other diagramming tools, VMF is still 
capable of enforcing model semantics and constraints. 

A minimum VMF architecture requires the surface 202, a 
host 204 and a paradigm server 206. Model persistence, such 

20 as in the form of a repository 208, is optional, but is very 
likely in many modeling scenarios, for example, to maintain 
properties and other information for model elements. In 
keeping with the present invention as described below, the VMF 
components such as the surface 202, core graphic components 
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and other components are designed to be reusable across 
modeling paradigms. For example, new model elements may be 
introduced by registering new paradigm servers (e.g., ActiveX® 
controls) . Similarly, new project types may be introduced, 
5 (e.g., as ActiveX® servers). Some or all of the components 
that comprise the VMF 200 may be incorporated into an 
operating system, such as the operating system 135 (FIG. 1) of 
the computer 110. 

The VMS host 204 is a tool that uses the services of the 

10 VMF 200 to solve a problem for the end user. In one 

straightforward situation, this tool may be a stand-alone 
executable program, wizard or add-in, with a specific problem 
domain for which it will provide solutions. For example, a 
simple host can be just a tool that hosts the surface 202 and 

15 a known paradigm server 206, e.g., a type-modeling tool may be 
created that utilizes a Unified Modeling Language (UML) 
paradigm server to model Visual Basic (VB) classes, and then 
generates the code for those VB classes. 

A more complex host may be a generic modeling tool that 

20 may be hosted through hosting layers in a variety of host 

shells, such as the shell 210 (FIG. 2) . Such a modeling tool 
may model virtually anything, using one or more registered 
paradigms and one or more project types 300 (FIG. 3) dedicated 




to solving problems utilizing those paradigms in different 
problem domains. More complex hosts, such as a generic 
modeling tool, can be hosted in a number of shells (including 
VS, IE, MMC, and Access) through thin hosting layers to 
5 provide shell independence. As described below, these more- 
complex hosts may also implement the project types 300 (like 
VB project types) to provide scenario-based tool support for 
individual sets of paradigms without compromising paradigm 
independence. 

10 In the VMF architecture represented in FIGS. 2 and 3, the 

visualization and modeling surface 202 comprises an HTML 
rendering engine 212 (e.g., browser and/or editor) such as 
found in Microsoft Corporation's Internet Explorer product. 
The surface 202 thus provides a complete HTML interpreter 

15 along with HTML editing capabilities. For example, the 

surface supports dynamic models built from Visual Basic and 
C++ ActiveX® controls and behaviors, as well as static models 
rendered in XML/VML. 

The surface 202 (which in one preferred implementation 

20 represented in FIGS. 6-9 comprises an ActiveX® control) 

provides the actual drawing canvas on which model elements are 
arranged to form diagrams, represented in FIG. 4 as the 
modeling surface window 400. As described below, the surface 
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202 also acts as the central communication point for model 
elements to communicate with each other, including 
facilitating interconnection negotiations as further described 
in United States Patent Application entitled ''Negotiated 
5 Interconnection of Visual Modeling Elements ^ assigned to the 
Assignee of the present invention and herein incorporated by 
reference . 

Most of the properties, methods and events of the surface 
202 are directed to adding, editing and deleting model 

10 elements, and to managing the interactions between them. A 
preferred modeling surface, to be provided to third parties 
such as independent software vendors, is further described in 
United States Patent Application entitled ^^Dynamic^ Live 
Surface and Model Elements for Visualization and Modeling, " 

15 assigned to the Assignee of the present invention and herein 
incorporated by reference. Note that while this surface 202 
is rich, consistent and straightforward to use, the surface 
202 provides a set of defined interfaces, and is thus capable 
of being replaced by an arbitrary component that supports the 

20 same set of interfaces. 

The surface 202 also includes or is otherwise connected 
to a Visualization and Modeling Engine (VME) 214 that provides 
additional support for rendering and editing models beyond 




that available via the rendering engine 212. In other words, 
via extensions, the VME 214 provides capabilities that the 
rendering engine 212 does not natively provide. For example, 
a more sophisticated way to determine whether one model 
5 element is above or in close proximity to another model 
element on the modeling surface/ known as four-point hit 
testing, is not natively handled by the rendering engine 212, 
but is instead provided by the VME 214. 

In one particular implementation using ActiveX® controls 

10 as represented in FIGS. 3 and FIGS. 6-9, a VMS host such as 
the host 204 may site the surface ActiveX® control 302, which 
provides standard ActiveX® interfaces to access the rendering 
engine 212. Any ActiveX® capability that the rendering engine 
212 does not currently provide natively, such as the above- 

15 described four-point hit testing, are also provided by this 

surface ActiveX® control 302. Alternatively, thin clients may 
access most of the same capabilities of the VMS ActiveX® 
control with Dynamic HTML, utilizing Document Object Model 
(DOM) extensions 304. 

20 As also represented in FIGS. 2-4, paradigm servers 206 

provide notations and semantics to hosts, such as the VMS host 
204, independent from the functional use of those notations 
and semantics. In one implementation, a paradigm server 206 
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may comprise an ActiveX® control server dedicated to providing 
and controlling the model elements of a single modeling 
paradigm. Notations and semantics, separated in accordance 
with one aspect of the present invention, are described below. 
5 A primitive server 306 shown in FIG. 3 (such as the 

graphic primitive server) may also provide any shared tools 
that multiple notations will likely wish to implement. For 
example, most model elements have some text which can often be 
formatted, and it would be inefficient for every paradigm 

10 server to contain its own text-formatting dialog and toolbar 
or in-place editing textbox. The graphic primitive server 
thus may contain these shared tools. By way of example, one 
graphic primitive server (e.g., 306 of FIG. 3) provides base 
shapes such as lines, polygons and ellipses from which more 

15 complex shapes may be constructed, i.e., it provides basic 
shapes to utilize as building blocks for the more complex 
notation objects of a paradigm server (described below) . 
Typical examples of controls provided by this server include 
base nodes ranging from simple non-sizable icons to more 

20 complex polygons or ellipses and base arcs ranging from simple 
node centered non-routable single segment arcs to routable 
multi-segment arcs with semantic adornments. These building 
blocks may encapsulate both shared graphical behavior such as 
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drawing, zooming, resizing, moving, hovering, and selecting, 
as well as shared modeling behavior inherent in the 
communication protocols with the surface, the host, semantic 
objects, and other notation objects (described below) . Thus, 
5 many complex behaviors such as zooming, resizing, moving and 
surface communication protocols are built directly into these 
primitive shapes, which, as can be readily appreciated, 
significantly simplifies the building of a notation server. 
As further represented in FIG. 2, model persistence 208 

10 may be provided as a generic pluggable component for a given 
tool. This component may be provided by the surface 202 or 
through a component known to the paradigm server 206. 
Persistence may be meta-model driven through information 
models or the paradigm server may already know the schema. 

15 More reusable paradigm servers will persist through a 

published persistence interface on a persistence component 
provided by the surface 202. 

Model persistence is optional. If persisted, VMF models 
are preferably persisted in the Open Information Model (OIM) 

20 in the persistence / repository 208, and therefore can 

automatically be used by existing and future tools. OIM is 
based on the Unified Modeling Language (UML) , which is a 
graphical language for visualizing and modeling. A suitable 
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persistence stream for VMF is XML/VML, however additional 
persistence formats, such as repository objects or database 
record sets, may be provided to the host. Moreover, in VMF, 
models are persisted through published COM interfaces for OIM 
5 and UML, whereby the actual persistence component may be 
easily changed from repository 208, to database tables, to 
XML, or the like, without effecting the paradigm servers. 
This component architecture maximizes flexibility and 
extensibility and increases the preservation of investment in 

10 the individual components as the applications of those 
component s change . 

The model persistence / repository 208 is designed to be 
a point of interoperability for software vendors. Any 
information placed in the repository 208 can be read, updated 

15 and extended by any application with appropriate access to 
that repository 208. Since update access is exclusively 
through published (e.g., COM interfaces), adding application- 
specific extensions through new repository interfaces does not 
effect those applications already leveraging the existing 

20 interfaces. 

As represented in FIGS. 3 and 4, the repository 208 may 
contain one or more models and/or templates 402, each of which 
may be composed of packages for organization. Templates 402 
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are static instances of models in the repository 208. They 
are usually designed to be examples or good starting points 
for modeling a vertical market domain, however they can also 
be design patterns (model structure templates) that can be 
5 utilized by wizards to apply a standard architectural design 
to a model. Many templates can be built dynamically as the 
user needs them through wizards. 

A model instance 308 includes model elements, diagrams 
and the projections of those model elements onto those 

10 diagrams. If the model is persisted in a versioned repository 
208 then a model instance includes the versions of model 
elements, diagrams and projections. Information models 310 
specify the schema for persisting model instances. They are 
meta-models of model instances and contain meta-data about 

15 those instances. For example, the repository OIM 404 

specifies the interfaces for persisting types, components and 
database entities. The schema of a particular database may 
comprise a model instance 308 of this information model 310. 
As also represented in FIG. 3, the surface component 202 

20 may provide universal shared components 312 that can be shared 
by hosts, such as to accomplish selection, hovering, zooming, 
and printing functions. Larger tools that may not be required 
by hosts and are thus optional may be provided as separate, 
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pluggable components 314* This reduces the footprint 
requirements of smaller VMF applications that may not need 
these components, and the physical separation also makes it 
easy to provide several alternative implementations of these 
5 components. By way of example, model-independent persistence, 
such as XML/VML persistence, is a good candidate for a 
pluggable component because not every host will need every 
persistence mechanism, and indeed, some will not require a VMF 
provided persistence mechanism at all. As another example, 

10 automatic graph layout is a suitable candidate for a 

pluggable, shared component because layout algorithms are 
substantially different for different classes of modeling 
paradigms, and yet a single layout algorithm is often useful 
for many or all modeling paradigms within a class. Automatic 

15 layout is further described in United States Patent 

Application entitled ^'Incremental and Inter ruptihle Layout of 
Visual Modeling Elements assigned to the Assignee of the 
present invention and herein incorporated by reference. 

FIG. 3 also shows a representation of project types, 

20 which plug into the host 204, e.g., through an application 
object. Project types may be UML-like collaborations 
described in the OIM of the repository 208. More 
particularly, each project type is a collaboration of modeling 
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paradigms, tools 406 (FIG. 4), wizards 408, command bars and 
templates, registered in the repository 208 and designed to be 
used together to accomplish a task. Command bars comprise 
menu bars and toolbars, and act as the hooks that link the 
5 project type into the hosting environment (the surface 202 and 
shell 210) • The tools 406 and wizards 408 of a project type 
300 may be accessed through its command bars. 

Project types can support a scenario, modeling paradigm, 
problem domain or an entire methodology. Virtually any 

10 scenario in the software development problem space may be 
addressed, e.g., abstraction layers, modeling paradigms, 
programming languages, product layers, product architectures, 
vertical market domains, development lifecycle and code 
architectures. Project types could be linked together into 

15 larger hierarchies to support many more complex scenarios. 

MODEL ELEMENTS - NODES AND ARCS 

In general, visual representations such as icons and 
shapes rendered on the surface are collectively referred to as 
20 model elements, (or projections) . In VMF, model elements are 
projected onto diagrams, (which in UML terminology is somewhat 
analogous to a projection being a single rendering of a model 
element on a view element) . Each model element instance 
projected on a diagram corresponds to exactly one model 

- 23 - 



element in a repository 208, however the same repository 208 
model element may be projected onto multiple diagrams or even 
several times onto the same diagram. 

A typical projection is implemented as a windowless 
5 ActiveX® control. Often the drawing notation and graphical 

behavior of the projection is handled directly by this control 
object. For very simple nodes, the control will also handle 
its own logical semantics. However, in accordance with one 
aspect of the present invention and as described below, this 

10 may be handled separately by a NotationObject owned by the 
projection control, and the control will own a separate 
SemanticObject to encapsulate this. Implementing a 
SemanticObject cleanly separates the logic of the object being 
projected (semantics) from the logic of the projection 

15 (notation) . If a separate NotationObject and SemanticObject 
exist, they can be accessed through the VMENode (FIG. 8) or 
VMEArc (FIG. 9) interfaces, (via GetNotationObj ect () and 
GetSemanticObject ( ) calls, respectively) , 

As generally represented in FIG. 5, each node 502, 504 is 

20 generally an icon, image, polygon, ellipse or other bounded 

shape, whereas an arc 506 is generally a line (possibly multi- 
segmented) that connects nodes (and sometimes other arcs) 
together. Arcs are used to connect two model elements 
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together, semantically forming a relationship between the two. 
Model elements, which may be comprised of associated notations 
and semantics in accordance with an aspect of the present 
invention as described below, are typically peer ActiveX® 
5 controls on a window 400 of the surface 202. Properties of 
the model elements are persisted in the repository 208. 

In one preferred embodiment, each model element in a 
modeling environment includes an ActiveX® control, (e.g., its 
notation) . As such, each model element can autonomously 

10 control most of its presentation and much of its notational 

semantics. Usually, these controls will be light, windowless 
controls to improve scalability of models and therefore 
utilize the surface or graphic primitive server to provide 
basic windowing capability where required. Note that while 

15 the behavior of projects and diagrams is type-specific and is 
implemented in the project type, and the behavior of model 
elements and their projections is type-specific, and is 
implemented in one of the paradigm servers, the behavior of 
other elements is type-independent and is implemented in the 

20 surface server 202. 

Each such model element thus also includes component 
interfaces, the primary purpose of which is to handle 
component communication between model elements, between a 
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paradigm server and the model elements it serves, and between 
the surface and the model elements it contains. As described 
below, the notation and semantics that comprise a model 
element are each objects having such interfaces. 
5 As also represented in FIG. 5, the exact point where the 

arc touches either of these nodes is known as the attach 
point. In FIG. 5, the two attach points are labeled 510 and 
512. The two attach points are conceptually owned by the arc 
but are managed by the surface 202. For example, the surface 

10 uses the attach points to determine whether other model 

elements may be affected when a model element is moved or 
resized, e.g., if a node is moved, then all of the arcs 
attached to that node will need to move with it. However, the 
surface 202 cannot move the affected model elements when an 

15 attach point moves, because it has insufficient information 
about how those projections should react to this move. In 
such an instance, the surface 202 is responsible for raising 
events so that each of affected model elements can respond 
properly to the change. 
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NOTATIONS AND SEMANTICS 

In accordance with one aspect of the present invention, a 
paradigm server (e.g., 206) may have some of its functionality 
separated into separate notation and semantic servers. In 
5 general, a notation server (e.g., 218) generally provides the 
visual representation (e.g., icons, images or shapes) of the 
paradigm, as well as the basic behaviors and rules for editing 
and connecting those visual representations. A semantic 
server (e.g., 220) provides direct access to the notation 

10 independent model (meta-data represented by the model) . 

To illustrate this separation more clearly, consider the 
following example, wherein the host is a Visual Basic add-in 
that facilitates generating class code automatically by 
drawing class models. This add-in readily allows switching 

15 between a Booch class modeling notation, where a class appears 
as a cloud shape, and the UML notation, where a class appears 
as a rounded-rectangle. A given code generator may require 
that the semantics of the class be restricted to that of VB 
classes. To make matters more complicated, this class control 

20 will be reused for a similar add-in for C++. In this 

scenario, the implementer of this node can cleanly separate 
the class node control from each of the two notation classes, 
and from the class of the VB class (SemanticObject ) . 




To this end/ notation servers (e.g., 218) may be 
implemented as VB or C++ custom control servers, or, for thin 
clients, they may comprise '"behaviors" of the rendering engine 
212. Semantic servers (e.g., 220) provide direct access to 
5 the notation independent model (meta-data represented by the 
model) . This is particularly useful for non-graphical hosts, 
like wizards and generators. Semantic servers may be COM 
class servers or behaviors for thin clients. 

The purpose of a paradigm server is to encapsulate the 

10 presentation and semantics of a modeling paradigm separate 

from the drawing surface and project types. This separation 
enables a high degree of flexibility and extensibility. To 
this end, there is one notation server (e.g., ActiveX® control) 
and one semantic server (e.g*, COM class server) per modeling 

15 paradigm. For example, paradigm servers may be provided for 

IDEFIX physical schema, server topology, DTS packages. Storage 
Plus Types, Semantic Data Types, and Repository Information 
Models. One drawing paradigm server may be provided to serve 
non-semantic model elements, such as line, rectangle and label 

20 elements. Each server is registered to VMF, and as part of 
this registration, the library class for the server is 
identified. 
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A notation server is responsible for providing the 
graphic visual representations (e.g., icons, images, shapes or 
the like) and enforcing semantics of those visual 
representations that are strictly independent of the semantic 
5 objects represented by those visual representations 

(notational semantics) . Notation servers supply a Library 
class component, a Toolbar ActiveX control component, and one 
or more model element ActiveX control components. The library 
class holds the global scope for the server. Any information 

10 that is server specific, but is not model element specific, 
can be acquired through the library class. Initializing the 
library class initializes the server including all shared 
memory for the server. Each paradigm server provides a 
toolbar to appear in the shell when the paradigm server is 

15 loaded. This toolbar control is actually provided to the 
shell through a property on the library class. Most of the 
toolbar buttons on this toolbar will correspond one-to-one 
with a model element the server can create. However, there 
may also be buttons for other tools the paradigm server can 

20 provide. For example, when a model element toolbar button is 
pressed, a new instance of that model element is provided to 
surface. This new instance will be placed at the next point 
on the surface that is clicked. 




Semantic servers are is responsible for providing the COM 
classes that encapsulate the semantics being represented by a 
notation separate from the notation itself. In keeping with 
the present invention, this separation of semantics from 
5 notation enables, among other things, non-graphical clients 
(e.g., generators) to still be capable of accessing the 
semantics of the model. 

The separation of the notation from the semantics thus 
allows different combinations (associations) of notations and 
10 semantics to be used as the modeling tool or the user sees 
fit. To enable the associating of the notation with the 
semantic, the objects implementing notational and semantic 
objects preferably comply with certain interfaces. 
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Notations implement interfaces that provide the following 



information, including that set forth in the table below: 



(1) 


Library of notations to which the notation belongs, 
e.g., UML, IDEF and so forth). 


(2) 


Type and Subtype of the notation. 


(3) 


Name of the notation. 


\ ^ ) 




\ ^ ) 
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(6) 


Whether the notation is capable of showing/hiding 
itself. 


(7) 


Whether the notation is capable of visually 
indicating hover over/out as the cursor flies over 
to make interconnections. 


(8) 


Whether the notation is capable of visually 
indicating attach-points at which arcs can connect. 


(9) 


The minimum/maximum size of the notation. 


(10) 


Whether the notation is capable of zooming itself. 




oUpporuea coior aepuns ^e.g., ^:jjxc, fioiL, iddil ana 
so forth) . 


(12) 


The iconic representation (e.g., so that the 
notation can be put in a tool palette) . 


(13) 


Whether the notation is capable of doing 
animations. A separate interface needs to be 
supported if the notation supports animation. 


(14) 


The number of states that the notation can visually 
indicate. 



Further, notations include interfaces to effect changes 
5 in the notation based on what they support. For example, 
there may be other interfaces / methods to change size, 
position, selection, visibility, color, state of the notation 
and so forth, depending on each notation's capabilities. 

Semantics implement interfaces that provide the following 

10 information, including that set forth in the table below: 
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(1) 


Library of notations to which the semantic object 
SO forth) . 


(2) 


Type and Subtype of the semantic object. 


(3) 


Name of the semantic object. 


(4) 


Requires a resizable notation. Sizing has a 
meaning semantically . 


(5) 


Requires notation capable of selected/unselected 
states . 


I o J 
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(7) 


Requires notation capable of hover in/out states. 


(8) 


Number of attach-points required. 


(9) 


Color depth range required. 


(10) 


Animation required. Number of animation states. 


(11) 


Number of states required. 



Semantics may also include domain-specific knowledge. 



which are implemented as separate interfaces specific to each 
domain. These interfaces are queried to accomplish domain- 
5 specific communication. Notation and semantic objects are 

found to be compatible by going through their interfaces. The 
VME paradigm server then makes the association between a 
notation and a semantic based on a tool or user preference. 

By way of example, as represented in the flow diagram of 

10 FIG. 10, at step 1000 a paradigm server (e.g., 206) is 

provided with information about a notation object (e.g., 218) 
such as when selected by a user or the tool. At step 1002 and 
1004, the paradigm server 206 validates the notation for this 
particular paradigm, by communicating with the notation object 

15 through its interfaces to determine its type, subtype, name, 
capabilities and/or any other type of information that it 
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wants to know and can obtain from it. In essence, the 
validation performed at step 1002 evaluates the compatibility 
of the notation server (object) with the paradigm server. For 
example, a notation representing an electrical outlet will 
5 work with an electrical wiring paradigm, but not in a database 
design paradigm. Note however that in keeping with the 
present invention, a more generic notation may work with both, 
as the semantic object to which it connects may determine its 
meaning in the environment, e.g., a rectangular-shaped 

10 notation may be used in virtually any environment, with its 
meaning in a given environment dependent on its associated 
semantic. As represented by step 1004, the paradigm server 
either accepts or rejects this notation, returning either a 
failure indication (step 1015) or continuing if successfully 

15 validated, possibly returning success information for this 
phase . 

Similar to the notation validation, at step 1006 a 
paradigm server (e.g., 206) is provided with information about 
a semantic object (e.g., 220) that is attempting to associate 
20 with the notation, such as when selected by a user or the 
tool. As represented by steps 1008 and 1010, the paradigm 
server 206 validates the semantic for this particular 
paradigm, by communicating with the semantic object through 
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its interfaces to determine its type, subtype, name, 
capabilities and/or any other type of information that it 
wants to know and can obtain from it. As represented by step 
1012, the paradigm server either accepts or rejects this 
5 semantic object, returning either a failure indication (step 
1016) or continuing if successfully validated, possibly 
returning success information for this phase. 

At step 1012, a determination is made as to whether the 
notation and semantic servers can be associated with one 

10 another. For example, as set forth above, the semantic server 
may have certain requirements about the notation server, e.g., 
the notation server may have to be resizable or it is not 
compatible with the semantic server. The paradigm server 206 
can make this determination, or alternatively, the paradigm 

15 server can provide the interfaces of each to one another, 
whereby the semantic and notation objects can determine 
compatibility themselves. In any event, step 1014 represents 
the compatibility test, which either results in a failure as 
represented by step 1016, or success, whereby the notation is 

20 associated with the semantic, thereby providing a model 
element as represented by step 1018. 

Note that in FIG. 10, the actual order in which 
compatibility among the paradigm server, notation server and 
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semantic server is checked, or the order in which object 
information is received is not important. For example, the 
semantic object can be selected and checked prior to checking 
the notation object, or even essentially at the same time. 



there is provided a separation of notations and semantics and 
later selective re-association thereof that eliminates many of 
the drawbacks of the prior art. Via separate notations and 
semantics, the present invention provides significant 

10 flexibility and extensibility, e.g., as new types of 

components are developed or as requirements change, new 
notations and semantics can be developed to handle them. 
Moreover, a notation or semantic developed and/or used in one 
environment may be used in a different environment. 

15 While the invention is susceptible to various 

modifications and alternative constructions, certain 
illustrated embodiments thereof are shown in the drawings and 
have been described above in detail. It should be understood, 
however, that there is no intention to limit the invention to 

20 the specific form or forms disclosed, but on the contrary, the 
intention is to cover all modifications, alternative 
constructions, and equivalents falling within the spirit and 
scope of the invention. 



5 



As can be seen from the foregoing detailed description. 
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